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**K-y, SfcaaEW-fflU K^tffifc (Video surveillance) ffl tfl 3£ 

ball( StartTime, EndTime, number of Nodes, Trajectory ) 

Activity = { lie, sit, fall_down, raise_hand s dive, hand_throw, throw_in, 
jump, stay, walk, run, sliding, kick, overhead_kick } 

Wh, mtlXt$± (lie) , loTflJh (sit) % ffltLZ (fall_down) 
, (raise_hand) , # 4 \£ *y if (dive) % ^ Is K • ^ a — ( 

hand_throw) N >\ D — • ^ > (throw_in) N -Y ^ ^7° (jump) „ tL-^X 
f^ih (stay) , (walk) % ^£ (run) % ^ 9 -f f >i X/ if (sliding) 

, Et5 (kick) , if — /<— ^ y K • (overhead_kick) — 

if^^Ji: LT V (* 6 CO 1 ff S ~ 2 6 ft @) % P^i/.x-?^ ( 

3i6tf>28fTg~39ffg) % K • (^7(0 lt?S~l 4'ff 

i) ^ «5I«T^^ (^7C016tT@~3 3^Tg) , M^>^ (^ 8 tf) Iff @ 
~18fTS) , -feV^y^^ (^8<Z)2 0fTg~3 8ffg) , ( 



WO 00/45335 



15 



PCT/JPOO/00269 



o 

Sfc, lAct^teJB3;h,*ffi3ij|Mjg!t#*, *lOXtf*l lK^bfc 
ftfcv\ (Hl2 % 013, 014, BI15) 
^»**i- c (016, B17) 

^*fJr -7-^4 0 is, M^*o ; a4 i o©toi(cict, -^tt^cD 

»»?»9«vy/4 2 2, t^i?x^ hoi T>tftffrh*7V^i? F<D«i 
ilfc I D (4 2 4) , »fls#3S»*e>Sbfls ID (4 2 6) , 7»tf^*7c 
&mfrt>Jo * 7 • * 4 2 8 *f #W e>*l5. 

*£«fc — ^co^jf^, t-^^-r — ^ 4 0 1 ^e,it^, * k b 

itLfe 4 2 0 <0?—9&frb*'7 ; &*9 hCi 5 fcT?*;*-E&Act4 3 

• 4 o i ^ji^i-sr txmi>^x%tbtiz>7£m 

Refplane) 4 4 2 ri* » P> 5 » 

^7t'7-^4 0 1^I^t5^ ( !:T*, ^^-^4 0 

*»feJic5'>~^Ofit!*#^S:IEi£Ufc, ^EifilAct (4 5 6) 



WO 00/45335 

16 

m=^^iy^4 6 0(± % ^---r • K4 7 0 £fl?#?LT, 

* MaiiB4 3 0 t '>->m^4 5 6ii^, *t/&-f<5 Vf* - x-^ 4 0 

^Oi: >lEi!i4 5 6 (i % Refplane4 2 2 <£ tfAct 4 3 0 £*n. 

s -r z> ^ t -c , mm -r s m e m* m-r 0 

Refplane4 2 2*5«tt)«Act4 3 0 ^ttfSr £; X*. ^ — fem<D — ^ 

a-— ifiiv ftifi 5 o o oq^j&gfrgci &3?£Hfite-#- 

, «f*lO}|«5 2 0, (fire (4»@f) ©^5 3 0 , ^ Ltl^jt^ 5 
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( b ) ^tiTZf i/3L ? Y <£>i!fffE ]) -7 7 ' Zf U — >±<D&ff$&)&ik%: 

(c) 3i # h(Dmtfi$HtZm\^X , K©3fX£©» 

<d) ajBc*^^*^ i 19 ->->iSr^it5XTy^^ 
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( b) Jttffittpiy— ^fcfiH*^ yf. Or-? h®.m I D, I 
Utile** ^ - *-*ti*b*~7*JaLjr h!CJ;51!if^lEaz6Srf^fiai-6^ 

( b) tfltd.W)m j f-?frbmi&^' yf, irzf'y^^ hW.B I D > SJjf^ I 
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( b) fft$5,mi&^ tit)%za--7i?^? h$hW I D % mti^hiP I DRTfi 

triads. 

mm?—'? &&mi- z>Tzib(D s gm^—f ^t&m. Lfc=» 

9. (a) MIElfiS-r — {C^-StLa^-y^i ^ htf>&gtt$8£r^§H" - 

(c) =s-^-^^^^ ho^*t«^k*ffiv>r, # hoffifeoW) 

(d) ««r^-^i?i^ Mci 9 *>- y^fc % 
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Reference plane: := Model of the ground (SBffii©*^) 
<Ref ID> text Name of reference plane 

<Plane> coordinates Center of the Area (e. g. (0,0)) 

(a *> («*.tf (0, 0) ) ) 

<metric> array of numeric — define transformation (e. g. 3 X 3 matrix for 
(ttttOEM) Affine transformation) 

y — > (Zone Desrri'ntin^) tnffl* : 

Zone Description: - Define meaningful space on the ground 
( » f£ ffi _b CD ft Sfc <£> £> 5 * — ^ CO J£ ft ) 

<Zone ID> text Identified the zone on the ground 

h) (e.g. Goal, Center line) 

-fe V*— . ^*?) ) 

< Space > space desc define the space on the ground 

(Camera Snec) <pflP.ftE far^v^^) . 
Camera Spec::= Define camera model 

<Camera Type> text — Identify camera model 

< Param Array> array of numeric define model transformation 
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Action:: Describe single player's action 



<Action ID> text 



<T~Interval> time interval 
(0#B8B8I») 



<0bject ID> numeric 

mm 

<Trajectory> Time Stamped Polyline - 



Action Symbol (e. g Run, Kick, Walk, etc) 

Run, Kick, ftjf) ) 
Time Duration of this action 



Trajectory of the player in this action 
( * co fflifls £ ff o T V ^ fc E B8(i jstf 5 



Object Identifier 
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I A c t i o n COl?.yg : 

IAction::= Meaningful event in the domain, composed of multiple players and ball 

<JAction ID> text Event Symbol ( e. g Shot, Pass, 

Through Pass, etc) 

<T-Interval> time interval Time duration of this action 

<No of ObjecO numeric Number of objects 

{ObjectID] array of numeric — Array of Objects identifier 

<Space> Trajectory, Spatial description of this action 

Polylines, Polygons (^(D-f^^ b t^TtoHt^mBf^^m) 
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begin 

IActJtlt 

IAct, ^Act, ¥baU(Z>3£Xfi ( ^IAct t d^Act^tt, £ ^IActSr«/*i"^ IAct, 
ActSrJR*-rs) - 
where 

fill 

[Stt-f SIAct^SJR^Att] 

end 







f 




t 




o 


sfr 7 its.? h 
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p 
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mm 



1 begin 

2 iact Through.pass tO O0 L0 

3 childjact 1 Pass t1 01 L1 

4 child.act 3 Stay Walk Run t2 o2 false L2 

5 

6 child.act 3 Stay Walk Run t3 o3 false L3 

7 where 

8 greater than o2 o3 

9 get,objBctfrom_GO o4 1 01 

10 not.sama.team o4 o2 

11 not same_toam o4 o3 

12 setJength.of_polyline dO Li 

1 3 less.than dO 20.0 

1 4 temp oral_ overlap t2 t3 

1 5 3et_tomporal.ovoriappingj>eriod t4 t2 t3 

1 6 tempore ^overlap tl M 

1 7 set.temporal_overlappin£period t5 tl t4 

18 getframe.start of period 10 t5 

19 

CetJrame_end_cf_period fl t5 

20 «et_ST.GL_dividing_point pO L2 fO 

2 1 «et_ST_GL_dividing_point pi L3 fO 

22 eet.ST.GL.dividintPoint p2 L2 fl 

23 set.ST.GL.divtdin^point p3 L3 ft 

24 get_point.from_polyline p4 1 L1 

25 Betj>oint.from.po)yline p5 -1 LI 

26 Create.line PI 2 p4 p5 

27 Create.line P2 2 pO p1 

28 Create.lina P3 2 p2 p3 

29 spatial.cross PI P2 

30 set_distence_point_and_line dl pO p4 p5 
3 1 set.distance.point_andJine d2 pi p4 p5 

32 less.than dl 7.0 

33 less.than d2 7.0 

34 spatial.eross PI P3 

35 8*t_distance_point.and_line d3 p2 p4 p5 

36 set.di stance _polnt_andJtne OA p3 p4 p5 

37 less.than d3 7.0 

38 less.than d4 7.0 

39 fill 

40 tOtl 

41 oooi 

42 L0L1 

43 end 



CCT'lilact "Through Pass" $S3S ?"-£>. 

&l^tiSll!2!^1<DAct(r*lli. J-WxQHO o2CDAA<, B$EJWH20>M Vl»L2* 
M^nfA^(Stfly^L<l*W B lk=tL<liRun)LTL^ ) 

lact("Pass-)£0-A@«4f'?T^Tit»o4^Atl* 
o2.o4lJj3iJCO^--L 

^(75ffi«ri)^(Sra$at»t4*N 
t4tlact/<XCO^EnfllZfi*£A«^5) 

&fj6fO^Ef^t50M* a :7U--£*£ A*i.£ 
e*/Sn^ttEMt50ttT7l^-^£A;K* 

H^fO0B^(7>'g»fi3ni'jjs^iroii(a(tt!^)$je»po^ 
B§^fofl)B9OT i g i «!j(fiiiia^2^tia(itij^)$^»p 1 ^ 

/<A0)$*Tit!i££p5^ 
p4ip5$*2A,/£HK/*X£Da— A)£tt* 

pOi:p1^«^£«l{^jSfOI=fcft-&2A<0^<a««IS^*8A/f£«) 

p2tp3$JS^tt(^^fiizfcMt^2A(7)^W«iIJa^^n/^fc*tt) 

PltP2A<5SLTl^ 

D%^fO|-fcMt^pO<7)y^-7.3! f ^(05§tt*^tf3^ 
ff J^fOlC^t-f^plOT/^-X^^JgXt^^fti) 

P1tP/t<SSLTL^ 
S§*ftl±7m&f*) 

tl (lact/<X)G>f#KM£tO(lactX;U— /^ACOB^ B WJIZrtA 
OKlact/ ^A)<7)^>>x^H|^01(lacLAJU— y^A(7)^7vx^h«)^ttA 
L1(lact/tA(75(5nBr)SLO(laclA;t/— / tAWSralSJ&^tt A 
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1 






' 2 


begin 




3 


Iact Pass tO 00 LO 




4 


Child_act Kick | Jump | Sliding tl ol LI 


5 


Child_act Run | Stay | Walk t2 o2 L2 


6 


Ball t3 L3 




7 


where 




3 


same_team(ol,o2) 




Q 


get_frame_start_period fl t3 




10 


get_frame_end_period f2 t3 




11 


tempora!_overlap tl t3 




12 


temporaJ_overlap t2 13 




13 


set ST_GL_dividing_point 


pi fl L3 


14 


set_ST_GL_dividing__point 


p2 f2 L3 


lb 


set_ST_GL_dividing_point 


p3fl LI 


16 


set_ST_GL_dividing_point 


pA f2 L2 


17 


set_distance point_to_point 


dl pi p3 


18 


set_distance point__to_point 


d2 p2 p4 


19 


Lcss^than dl 0.5 




20 


Les$_than d2 0.5 




21 


set_GO_from_objects 01 2 ol o2 


22 


fill 




23 


tO t3 




24 


LO L3 




25 


O0O1 




26 


End 




f>7 
Z / 






28 






29 


begin 




30 


iact Long_pass tO 00 LO 




31 


childjact PassU 01 LI 




32 


where 




33 


setjength_of_po!yline dO LI 




34 


GreaterJThandl 30.0 




35 


fill 




36 


tOtl 




37 


OOOl 




38 


L0L1 




39 


end 
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1 7 4—b*<><*: 

2 begin 

3 Iact Feed Pass tO 00 LO 

4 Chldjact Passtl Ol LI 

5 Child_act Run t2 o2 L2 

6 where 

7 get_object_from CO o3 -1 01 

8 same_object o2 o3 

9 temporal_during tl t2 

10 fill 

11 tO tl 

12 O0O1 

13 LO LI 

14 end 
15 

16 $ftft?T/<X: 

1 7 begin 

1 8 Iact Cross pass tO 00 LO 

19 Chldjact Passtl Ol LI 

20 where 

21 get_frame_star_period ft tl 

22 get_frame_end_period f2 tl 

23 set_ST_GL_dividing_poim pi fl LI 

24 set_ST_ GL dividing jtoint p2 f2 LI 

25 set_length_of_ Polyline d 1 LI 

26 set_X_distance_point_and_point d2plp2 

27 greater_lhan dl 30.0 

28 lessjhan d2 5.0 

29 fill 

30 tO tl 

31 O0O1 

32 L0L1 

33 end 
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2 begin 

3 Iact Gain_pass to O0 L0 

4 Chldjact Passtl 01 LI 

5 where 

6 getJVame^star^period 

7 get_frame_end_period 

8 set_ST_GL_dividing^_point 

9 set_ST__GL_dividing_point 
10 set Jength_of_ Polyline 



fl tl 

a ti 

pi fl LI 
p2f2 LI 
dl LI 



11 setjy_distance_point_and_point d2 pi p2 

12 greater_than dl 30.0 

13 less_than d2 5.0 

14 fill 

15 tOtl 

16 O0O1 

17 L0L1 

18 end 
19 

20 ir^^yv^'; 

2 1 begin 

22 Iact Cross pass to 00 LO 

23 Chldjact Passtl Ol LI 

24 where 

25 get_frame_star_period fl tl 

26 get_frame_end_period f2tl 

27 set_ST_GL_dividing_poirit pi f1 Li 

28 set_ST_GL_dividing_point p2 f2 LI 

29 set Jength_of_ Polyline dl Ll 

30 greater_than dl 8.0 

31 set_X_distance_point_and_point d2 pi p2 



32 less_than 

33 5patial_point_in 

34 f,H 

35 tOtl 

36 O0O1 

37 L0L1 

38 end 



d2 5.0 

p2, "Goal Area" 
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1 |gx^ ; 

2 begin 

3 iact l-2__pass tO OO LO 

4 child Jact Pass tl 01 LI 

5 chi!d_iact Pas t2 02 L2 

6 child_act Stay Walk Run t3 ol L3 

7 where 

8 get_object_from_GO o2 1 Ol 

9 get_object_from GO o3 -1 01 

10 get_object_from_GO o4 1 02 

1 1 get_object_from_GO o5 -1 02 

12 not_same_team ol o2 

13 same_object o2 o5 

14 same_object o3 o4 

15 set__temporal_distance_period il tl 12 

16 Less_Than il 5 

17 not_5ame_team ol o2 

38 set_temporal_concatination_period t4 tl t2 

1 9 temporal_during t3 t4 

20 get_frame_$tart_of_period fl t4 

2 1 get_frame_end_ofj3eriod fl 1 1 

22 get_frame_end_of_period f3 t4 

23 set_ST_GL_dividing_poim pi LI fl 

24 set_ST_GL_dividing_point p2 LI 12 

25 set_ST_GL_dividing_point p3 L2 f3 

26 Create_Area Al 3 pi p2 p3 

27 set_ST_GL_dividing_point p4 L3 fl 

28 set_ST_GL__dividing_point p5 L3 f3 

29 spatiaJ_point_in p4 Al 

30 spatiaI_point_in p5 Al 

31 set_ST_GL_concatinate_polyline L4 LI L2 



32 fill 

33 tO t4 

34 OOOl 

35 L0L4 

36 end 
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same_tean> ( PlayerO, Player] ) 
same_team( Player, Location ) 

PlayerO £ Pl aye rl AmC^-^m^ f H^7ri- 0 



(2) •^y^-^T-'b-^i^fieat-sfiaa 



n 


[Temporal] 




l 

2 


get frame start of period(f1 tl ) 


ftEfBj t n omm&z 1 1 ^ ft a 


3 


o- ■ : — • ■ "m.w. v>i iu m per i oa ^ T I , X | 

set_per iod_f rom_frames ( tl, f1, 


} 

f2 ) 




4 


get period of GL( t1. Ll ) 




5 


_ temporal in( fl, t1) 


f 1 A^ESfel t 1 0) WM!"*,^ 


6 


temporal_meet ( tl. t2) 




7 


temporal overlap( tl. t2) 


WKffltl. t 2f=£&ftB«ISffl*<fc.& 


8 


temporal start (t1.t2) 


WBM t 1 , t 2*<H-aM*&B*A£tt-? 


9 


temporal f i n i sh (t 1 , t2) 


WBM t i . t 2AW-o>i«7B«Mi«n>o 


10 


temporal, dur i ni> (t 1 . t2) 


B*EM t 1 395, ft M t 2 (z^l^^ n-5 


11 


tempera l_equa I (t1, t2) 




12 


temporal_before(t1, t2) 


9ULni] 11,112 OBBJSB?^ J; 0 ^ir^TT^ 0 lB3£fl*KM 


13 


set_tempora l_over lappi ng_per i od (t1 , 
t2, t3 ) 


3f EM t2tt3 ©ffiffl"*-* B#£R3& t 1 — ftA 


14 


3e t_tempora l_concatinat ion_per iod (t 
1. t2. t3 ) 


BfrKM t2it3 LfciSEM* t l — ftA 


15 


3et_tempora I _d i stance_per J od C i 1 , 
2, t3) 


t 


■*KWt 2<oa«l^t t StDINI^iAOSgfrB^Em^ i 


16 


set_ST_GL_di viding locus( LI 
L2) 


tl. 


£ L l A 


17 


fiet_ST_GL_concat inate_ locus (Ll . 
L3 


L2. 






Spatial! 




18 


set_STJ3L__dividing point ( p1 
fl) 


L1. 




19 
20 


set point from locus (pi. M) 

Set nnint fr» 1 1 1 I o^ 


WW*'— * <0 1 £ l 1 £ftg^r-$ p i iz&& 


21 


Oreate_Poly 1 ine( PI. i1, p1, p 2, . 


..) 


11. 12$ x, yMm&BplSSfl 

P 1 * P2.... (1B&*- i 1 T^f) "C<1^;h,£,6&^ 



F0© n U© 
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(2) ■fry*-<a*-ct-»ftKrttt-rs BB ft 



# I [Temporal] 




22 


ureaxe^Area knl, 1 1 , p 1 , p2 f , . . ) 


F % c • 0 V. Ua iX "2: 1 1 C/TTJ Xf?0 4lOift«o 


23 


Set 1 f»n £7+ In nf n/tlwl I ^ _1 1 V< \ 

ac 1 c '»b tn__or__po i y i inev, ol, XI ) 

7 


XiT^£;h.Stfr;h*aco£££d l ^ ftA, xi liPtL<!4 
L 


24 
*** 


set_distance__point_and_point dl, pi, 
d2 ) 


1 1 — % a ^ ibjv/-^ y j y r ic.N\l *ar u 1 IT .A.. xlJp t> L* 

<I4 1 


25 


se t_X__d i stance_po i nt_and__po i nt dl , 
xl, x2) 


{& fHx 1 * x 2 PeA 0} x Sift 1- T*<7) S5Etf**rti^«»-'x ^ i-f ^ j i > 
14 1 


26 


OKi *■ 1 _ u i 5iance_po i n t_and__po i nt vd I , 

x1 , x2) 


14 1 


27 


S 6 1 fj 1 S 1 3 H C P nn i nt 9n rl !*_._/ j 4 4 

**** w ■ a ioc_pu 1 nx_ano i i nc v Q 1 x 1 
PI) 


{£flgx 1 t f/rtlll P 1 £ £??EM£ d 1 'sftx vH ft i,i ✓mi 


28 


**** — w ' * miiwc — po i ni_ano a r c 3 ^ ol x j 
A1) 


*£{gxl k&ihMA 1 ££>S§f36*- d i >MtA x li u i i <r it i 


29 


spatial ooint in(pt t Xl) 


fcgp 1 *<X 1 ©*(::*g:3fc*. XI4P^L<I4 A 


30 


spatial line in (PI A1) 


tfrtifc P 1 A l (DtptZK&lz-S&tLZi 


31 


spatial apart CP1.P2) 


2 :fcCOttr*t,tfl p T „ p 2ICgi#lJA<JUlx 


32 


Spatial 1 ine touch (PI, X1) 


P 1 tX 1 XI4P^L<i4A 


33 


spatial throueh (P1 , A1) 


P 1 J&<£ftff2A 1 $a^TL»t 


34 


spatial over I aD (A1, A2) 


2O(0^ftffMl. A2lzmftf6fllfr)6<& > 5 


35 


spatial contaiYi(A1. A2) 


A 1 A<A2|r%^|-^^^.^. 


36 


spatial area touch (A1.A2) 


A 1 t A2*><£t L<I4 &T?mLTl** 


37 


spatial dis ioint (A1. A2) 


A "1 A o |-# -fa- -4- X ftn y\ j/ » v 


38 


spatial cross ( P1 , P2) 






"Object handl ine] 




39 


same object ( ol, o2) 


2W^yino1, o 2l4fSJ-(D^^i?x^ K 


40 


not same object ( ol, o2 ) 


2 orot^yi Hoi, o 214^3£f-5^"^i>x^ r* 


41 


eet obiect from GO ( ol i1 01 ) 




42 


act_G0_from_objcct5( 01, M, 0 1, o2 
. . . ) 




43 


get number from 60 (i1, 01) 






.Numer ica I ] 




44 


greater than( x1. x2 ) 


xl >x2, x!4f, d, o 


45 


Jess than ( x1 . x2 ) 


xT< x2, x!4f, d, o 


46 


equal ( x1, x2 ) 


xl=x2, x 1* f , d . o 
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IMPORTANT NOTIFICATION 


International application No. 

PCT/J POO/00269 


International filing date (day/month/year) 
20 January 2000 (20.01.00) 


Applicant 

INTERNATIONAL BUSINESS MACHINES CORPORATION et al 



1 . Transmittal of the translation to the applicant. 

The International Bureau transmits herewith a copy of the English translation made by the 
International Bureau of the international preliminary examination report established by the 
International Preliminary Examining Authority. 



2. Transmittal of the copy of the translation to the elected Offices. 

The International Bureau notifies the applicant that copies of that translation have been 
transmitted to the following elected Offices requiring such translation: 

EP,CN,CZ,PL,US 



The following elected Offices, having waived the requirement for such a transmittal at this time, 
will receive copies of that translation from the International Bureau only upon their request: 

IL,JP,KR,SG 



3. Reminder regarding translation into (one of) the official language(s) of the elected Office(s). 

The applicant is reminded that, where a translation of the international application must be 
furnished to an elected Office, that translation must contain a translation of any annexes to the 
international preliminary examination report. 

It is the applicant's responsibility to prepare and furnish such translation directly to each elected 
Office concerned (Rule 74.1). See Volume II of the PCT Applicant's Guide for further details. 
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JA998222 


A SeeNotificationofTransmittaloflnternational Preliminary 
FOR FURTHER ACTION Examination Report ( Fo rm PCT/1PEA/4 1 6) 


International application No. 

PCT/JPOO/00269 


International filing date (day/month/year) 

20 January 2000 (20.01 .00) 


Priority date {day/month/year) 

26 January 1999(26.01.99) 


International Patent Classification (IPC) or national classification and IPC 
G06T 1/00 


Applicant INTERNATIONAL BUSINESS MACHINES CORPORATION 



This international preliminary examination report has been prepared by this International Preliminary Examining Authority 
and is transmitted to the applicant according to Article 36. 



This REPORT consists of a total of 



. sheets, including this cover sheet. 



□ This report is also accompanied by ANNEXES, i.e., sheets of the description, claims and/or drawings which have 
been amended and are the basis for this report and/or sheets containing rectifications made before this Authority (see 
Rule 70.16 and Section 607 of the Administrative Instructions under the PCT). 



These annexes consist of a total of _ 



sheets. 



3. This report contains indications relating to the following items: 
Basis of the report 
Priority 

T^on-establishment of opinion with regard to novelty, inventive step and industrial applicability 
Lack of unity of invention 

Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 

Certain documents cited 

Certain defects in the international application 

Certain observations on the international application 



II 


□ 


III 




IV 


□ 


V 




VI 


□ 


VII 


□ 


VIII 


□ 



Date of submission of the demand 

13 July 2000 (13.07.00) 



Name and mailing address of the IPEA/JP 



Facsimile No. 



Date of completion of this report 

27 November 2000 (27.1 1.2000) 



Authorized officer 



Telephone No. 



Form PCT/IPEA/409 (cover sheet) (July 1998) 



INTERNATIONAL PRELIlV&RY EXAMINATION REPORT 



li^^^ional application No. 

PCT/JPOO/00269 



I. Basis of the report 



With regard to the elements of the international application:* 
the international application as originally filed 

the description: 

pages 

pages 

pages 



□ 



, as originally filed 
, filed with the demand 



, filed with the letter of 



□ 



the claims: 

pages 

pages 

pages 

pages 



, as originally filed 

, as amended (together with any statement under Article 19 

. filed with the demand 



. , filed with the letter of 



□ 



the drawings: 

pages 

pages 

pages 



, as originally filed 

, filed with the demand 



filed with the letter of 



| | the sequence listing part of the description: 
pages 

pages 

pages 



, as originally filed 

filed with the demand 



. , filed with the letter of 



With regard to the language, all the elements marked above were available or furnished to this Authority in the language in which 
the international application was filed, unless otherwise indicated under this item. 

These elements were available or furnished to this Authority in the following language which is: 

| | the language of a translation furnished for the purposes of international search (under Rule 23. 1 (b)). 
| | the language of publication of the international application (under Rule 48.3(b)). 

| | the language of the translation furnished for the purposes of international preliminary examination (under Rule 55.2 and/ 
or 55.3). 

With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the international 
preliminary examination was carried out on the basis of the sequence listing: 

□ 
□ 
□ 
□ 
□ 

□ 
□ 



contained in the international application in written form, 
filed together with the international application in computer readable form, 
furnished subsequently to this Authority in written form, 
furnished subsequently to this Authority in computer readable form. 

The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 
international application as filed has been furnished. 

The statement that the information recorded in computer readable form is identical to the written sequence listing has 
been furnished. 

The amendments have resulted in the cancellation of: 

I I the description, pages 

1 1 the claims, Nos. 

I | the drawings, sheets/fig 



5. 



□ This report has been established as if (some of) the amendments had not been made, since they have been considered to go 
beyond the disclosure as filed, as indicated in the Supplemental Box (Rule 70.2(c)).** 

Replacement sheets which have been furnished to the receiving Office in response to an invitation under Article 1 4 are referred to 
in this report as "originally filed" and are not annexed to this report since they do not contain amendments (Rule 70.16 
and 70. J 7). 

* Any replacement sheet containing such amendments must be referred to under item J and annexed to this report. 
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|onal application No. 
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III. Non-establishment of opinion with regard to novelty, inventive step and industrial applicability 



1. The questions whether the claimed invention appears to be novel, to involve an inventive step (to be non obvious), or to be 
industrially applicable have not been examined in respect of: 

1 1 the entire international application. 

claims Nos. 2z2 



because: 



the said international application, or the said claims Nos. 3-7 



relate to the following subject matter which does not require an international preliminary examination (specify): 

Claims 3-7 pertain to a scene search method or description method, and this activity is 
considered a method of implementing a purely psychological activity, so it does not require an 
international preliminary examination under PCT Article 34(4)(a)(i) and PCT Rule 67.1(v). 



□ the description, claims or drawings (indicate particular elements below) or said claims Nos. 
are so unclear that no meaningful opinion could be formed (specify): 



I — | the claims, or said claims Nos. '_ are so inadequately supported 

I J by the description that no meaningful opinion could be formed. 

t 

no international search report has been established for said claims Nos. hi • 



2. A meaningful international preliminary examination cannot be carried out due to the failure of the nucleotide and/or amino acid 
sequence listing to comply with the standard provided for in Annex C of the Administrative Instructions: 

[ | the written form has not been furnished or does not comply with the standard. 
| | the computer readable form has not been furnished or does not comply with the standard. 
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1 . Statement 








Novelty (N) 


Claims 


1,2,8,9 


YES 




Claims 




NO 


Inventive step (IS) 


Claims 




YES 




Claims 


1,2,8,9 


NO 


Industrial applicability (IA) 


Claims 


1,2,8,9 


YES 




Claims 




NO 











V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 



2. Citations and explanations 

Document 1 [Proposal for Search System in a Movie Using Short Time Action 
Descriptions in a Scene, (MIYAMORI, T.), Information Processing Association Symposium 
Papers, Vol. 98, No. 10 (Japanese), Information Processing Association (29.07.98), pages 1.75 to 
1.80] 

Document 2 [Study of Movie Scene Expression and Search System Using Short Time 
Action Descriptions, (MORI, T., ET. AL.) 5 Electronic Information and Communication 
Association Research Report, Vol. 98, No. 52 (Japanese), Electronic Information 
Communication Association (21 .01 .99), pages 107-1 14] 

Concerning Claims 1,2,8 

Documents 1 and 2 describe expressing the position and action in a soccer competition 
with position identifiers and action identifiers and thereby defining a scene (see document 1 , I- 
76, right column through 1-77, left column, "2.2 Applications to a Soccer Movie," etc.). 
"Reference plane" and "action description data" in claims 1 and 8 correspond to "soccer field" 
and "position identifier" respectively in documents 1 and 2, so the invention described in claims 
1 and 8 does not appear to involve an inventive step. 

Concerning Claim 9 

Documents 1 and 2 describe recognizing changes in the shape of an object and expressing 
status transitions of each object using position distinctions, action categories, and the time at 
which that status started and stopped (see document 1, 1-78, left column, line 12 through line 29, 
etc ). These points correspond to "(c) each object ... action-assigning step" and "(d) a plurality of 
objects ... defining step" in claim 9, so the invention described in claim 9 does not appear to 
involve an inventive step with respect to the inventions described in documents 1 and 2. 
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International application No. 


International filing fate 1 {day /month/year) 


Priority date (day/month/year) 


PCT/JP00/00269 


20 January 2000 (20.01 .00) 


26 January 1999 (26.01.99) 


International Patent Classification (IPC) or national classification and IPC 




G06T 1/00 






Applicant 

INTERNATIONAL BUSINESS MACHINES CORPORATION 



1 . This international preliminary examination report has been prepared by this International Preliminary Examining Authority 
and is transmitted to the applicant according to Article 36. 


? This RF.PORT consists of a total of - 4 sheets, including this cover sheet. 


□ 


This report is also accompanied by ANNEXES, i.e., sheets of the description, claims and/or drawings which have 
been amended and are the basis for this report and/or sheets containing rectifications made before this Authority (see 
Rule 70.16 and Section 607 of the Administrative Instructions under the PCT). 

These annexes consist of a total of sheets. 


3. This report contains indications relating to the following items: 


I 


El 


Basis of the report 


II 


□ 


Priority 


III 




^Non-establishment of opinion with regard to novelty, inventive step and industrial applicability 


IV 


□ 


Lack of unity of invention 


V 


13 


Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 


VI 


□ 


Certain documents cited 


VII 


□ 


Certain defects in the international application 


VIII 


□ 


Certain observations on the international application 



Date of submission of the demand 

13 July 2000(13.07.00) 


Date of completion of this report 

27 November 2000 (27. 1 1 .2000) 


Name and mailing address of the IPEA/JP 
Facsimile No. 


Authorized officer 
Telephone No. 
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PCT/JP00/00269 



I. Basis of the report 



1. With regard to the elements of the international application:* 
the international application as originally filed 

the description: 

pages 

pages 

pages 



□ 



, as originally filed 
, filed with the demand 



, filed with the letter of 



□ 



the claims: 

pages 

pages 

pages 

pages 



, as originally filed 

, as amended (together with any statement under Article 19 

, filed with the demand 



, filed with the letter of 



□ 



the drawings: 

pages 

pages 

pages 



, as originally filed 
, filed with the demand 



. filed with the letter of 



| | the sequence listing part of the description: 

pages 

pages 

pages 



, as originally filed 

_ , filed with the demand 



_ , filed with the letter of 



2. 



With regard to the language, all the elements marked above were available or furnished to this Authority in the language in which 
the international application was filed, unless otherwise indicated under this item. 

These elements were available or furnished to this Authority in the following language which is: 

| | the language of a translation furnished for the purposes of international search (under Rule 23. 1(b)). 
1 | the language of publication of the international application (under Rule 48.3(b)). 

| | the language of the translation furnished for the purposes of international preliminary examination (under Rule 55.2 and/ 
or 55.3). 

With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the international 
preliminary examination was carried out on the basis of the sequence listing: 

□ 
□ 
□ 
□ 
□ 

□ 
□ 



contained in the international application in written form, 
filed together with the international application in computer readable form, 
furnished subsequently to this Authority in written form, 
furnished subsequently to this Authority in computer readable form. 

The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 
international application as filed has been furnished. 

The statement that the information recorded in computer readable form is identical to the written sequence listing has 
been furnished. 

The amendments have resulted in the cancellation of: 

1 | the description, pages 

I 1 the claims, Nos. 

I I the drawings, sheets/fig 



□ This report has been established as if (some of) the amendments had not been made, since they have been considered to go 
beyond the disclosure as filed, as indicated in the Supplemental Box (Rule 70.2(c)).** 

* Replacement sheets which have been furnished to the receiving Office in response to an invitation under Article 1 4 are referred to 
in this report as "originally filed" and are not annexed to this report since they do not contain amendments (Rule 70. J 6 
and 70.17). 

** Any replacement sheet containing such amendments must be referred to under item 1 and annexed to this report. 
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nal application No. 
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III. Non-establishment of opinion with regard to novelty, inventive step and industrial applicability 



1. The questions whether the claimed invention appears to be novel, to involve an inventive step (to be non obvious), or to be 
industrially applicable have not been examined in respect of: 

I | the entire international application. 

[Xj claims Nos. 3^7 



because: 



the said international application, or the said claims Nos. 3-7 



relate to the following subject matter which does not require an international preliminary examination (specify): 

Claims 3-7 pertain to a scene search method or description method, and this activity is 
considered a method of implementing a purely psychological activity, so it does not require an 
international preliminary examination under PCT Article 34(4)(a)(i) and PCT Rule 67.1(v). 



□ the description, claims or drawings (indicate particular elements below) or said claims Nos. . 
are so unclear that no meaningful opinion could be formed (specify) : 



□ the claims, or said claims Nos. are so inadequately supported 
by the description that no meaningful opinion could be formed. 

no international search report has been established for said claims Nos. V7 . 



2. A meaningful international preliminary examination cannot be carried out due to the failure of the nucleotide and/or amino acid 
sequence listing to comply with the standard provided for in Annex C of the Administrative Instructions: 

[ [ the written form has not been furnished or does not comply with the standard. 

| | the computer readable form has not been furnished or does not comply with the standard. 
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1. Statement 








Novelty (N) 


Claims 


1,2,8,9 


YES 




Claims 




NO 


Inventive step (IS) 


Claims 




YES 




Claims 


1,2,8,9 


NO 


Industrial applicability (I A) 


Claims 


1,2,8,9 


YES 




Claims 




NO 











I Int^^Bnal appli 
| PCT/J1 



application No. 

PCT/JP00/00269 



V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 



2. Citations and explanations 

Document 1 [Proposal for Search System in a Movie Using Short Time Action 
Descriptions in a Scene, (MIYAMORI, T.), Information Processing Association Symposium 
Papers, Vol. 98, No. 10 (Japanese), Information Processing Association (29.07.98), pages 1.75 to 
1.80] 

Document 2 [Study of Movie Scene Expression and Search System Using Short Time 
Action Descriptions, (MORI, T., ET. AL.), Electronic Information and Communication 
Association Research Report, Vol. 98, No. 52 (Japanese), Electronic Information 
Communication Association (21.01 .99), pages 107-1 14] 

Concerning Claims 1, 2, 8 

Documents 1 and 2 describe expressing the position and action in a soccer competition 
with position identifiers and action identifiers and thereby defining a scene (see document 1, I- 
76, right column through 1-77, left column, "2.2 Applications to a Soccer Movie," etc.). 
"Reference plane" and "action description data" in claims 1 and 8 correspond to "soccer field" 
and "position identifier" respectively in documents 1 and 2, so the invention described in claims 
1 and 8 does not appear to involve an inventive step. 



Concerning Claim 9 

Documents 1 and 2 describe recognizing changes in the shape of an object and expressing 
status transitions of each object using position distinctions, action categories, and the time at 
which that status started and stopped (see document 1, 1-78, left column, line 12 through line 29, 
etc.). These points correspond to "(c) each object ... action-assigning step" and "(d) a plurality of 
objects ... defining step" in claim 9, so the invention described in claim 9 does not appear to 
involve an inventive step with respect to the inventions described in documents 1 and 2. 
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A. CLASSIFICATION OF SUBJECT MATTER 
Int. CI 7 G06T1/00 



According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 
Int. CI 7 G06T1/00, G06T7/00-7/20 , G06F17/30 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
JICST, JQUICK(JOIS) 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



Wararu Miyamori, "Scene chu no tanjikan ciosa kijutsu wo 
mochiita eizonaiyokensakuhoshiki no teian" , Proceedings 
of symposium, The Information Processing Society of Japan, 
No. 10, (Japan) , (29.07.98) , pages I. 75 -I. 80 

Wataru Miyamori, etal., "Tanjikandosa kijutsu wo mochiita 
eizo no scene hyogen to kensaku hoshiki no kent o M , Technical 
research report, The Institute of Electronics, 
Information and Communication Engineers, Vol.98, No. 527, 
(Japan) , (21.01.99) , pages 107-114 

Tomio Echigo, "GMRF to optical flow wo riyo shita sakka 
eizo no object chushutsu" , Proceedings of symposium, 
Information Processing Society of Japan, Vol.98, 
No. 10, (Japan) , (29.07.98), pages I. 443-1. 448 



1,2,8,9 



1,2,8,9 



1,2,8,9 



□ 

Further documents are listed in the continuation of Box C. Q See patent family annex. 



° Special categories of cited documents: 

"A" document defining the general state of the art which is not 

considered to be of particular relevance 
*E" earlier document but published on or after the international filing 

date 

U V document which may throw doubts on priority claim(s) or which is 
cited to establish the publication date of another citation or other 
special reason (as specified) 

u O n document referring to an oral disclosure, use, exhibition or other 
means 

"P" document published prior to the international filing date but later 
than the priority date claimed 



"X" 



later document published after the international filing date or 
priority date and not in conflict with the application but cited to 
understand the principle or theory underlying the invention 
document of particular relevance; the claimed invention cannot be 
considered novel or cannot be considered to involve an inventive 
step when the document is taken alone 

document of particular relevance; the claimed invention cannot be 
considered to involve an inventive step when the document is 
combined with one or more other such documents, such 
combination being obvious to a person skilled in the art 
document member of the same patent family 



Date of the actual completion of the international search 
05 April, 2000 (05.04.00) 


Date of mailing of the international search report 
18 April, 2000 (18.04.00) 


Name and mailing address of the ISA/ 

Japanese Patent Office 

Facsimile No. 


Authorized officer 
Telephone No. 
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Box I Observations where certain claims were found unsearchable (Continuation o f kern I of first sheet) " 
This international search report has not been established in respect of certain cl aims under Article 17(2)(a) for the following 



; reasons: 



_ Claims Nos.: 3-7 

because they relate to subject matter not required to be searched by this Authority, namely: 

The subject matters of claims 3 to 7 relate to a seen? e M rrMr,r, m~*-v.~. 
scene describing method, which is a method ^ 
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This International Searching Authority found multiple inventions in this international application, as follows: " 
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search report is restricted to the invention first mentioned in the claims; it is covered by claims Nos.: 



Remark on Protest □ The additional search fees were accompanied by the applicant's protest. 

Q No protest accompanied the payment of additional search fees. 
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